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ABSTRACT 



This .uor iking document describes 
facility: on it ft> SD S 940 from 12 



a method of extending the AHI-NLS 
to 32 consoles. 
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FOREWORD 

Purpose 

Tuiis imemo discusses the usefulness of small computers as 
special-purpose hardware device controllers and as complex* 
pr..agr airnu d feedback mechanisms. 

Tilings ana simulations indicate that the current level of SDS 940 
response lard d i sp lay-iori en ted feedback can be i»a inta inedt and 
a»a2ybe» improved* while the nam oer of consoles is tripled. 

The c:ertr;a lizat i o n of the display buffers ano tthe use of small 
computers as display iccntroilers allows experimentation *ith 
ring- structuring techniques for inter-console collaboration. 

Sii:Qi LarLy t -the use of small computers as input 'device controllers 
contributes to coliao oration by providing an elegant means for 
isLnkins an arbitrary icel lection of input devices to any console. 

final; ly* *the small machines can quickly react to most of the 
singl e-jcinaructer NLS linteractionsi reducing the frequency of 940 
cDaijpu t«it ion per user and thus reducing swapping* 

Hi st ur^y 

Tiais iracmoi is tire result of discussions held in late December 1968 

acta early January: 196-9. 

Tiii> main .contributors have oeen Roger Sates in hzrduare and Don 
AodPeusi i8i.il Paxtcnt and Jeff Rulifson in software. 
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GOALS 



The limit ia I study of: 940-NLS operating characteristics centered 
arouad t.he <joal of operating 12 worK stations with response 
equivalent to the 6 currently operating. 

SDttLenecks in the 940 system are connected with core space ami 
s^app i-ng* 

Currently, displays are stored in 940 core. Each user has his 
own buffers* and a\ new 940 core page is frozen as each user 
enters the system For 5 or 6 users this is not too bad, but 

for aio:re than 7 or 8 it is totally unreasonable* 
seedG ADS »Conc lusiions ) 

The immediate feedback that NLS gives to each user is 
significantly more complicated than that which can be offered 
th.rcus h conv ent iorca 1 echo tables. 

Consequently, each NLS user must be immediately activated 

i ton each character or button push. 

Statistics on NLS usage indicate that* i f ithe display buffers 
are removed from 940 memory, approximately 10 to 12 work 
staitions can be serviced before the swapping reaches a 
critical point* and response significantly declines. 

see; (LOADS *C one 1 usions ) 

Tfoe most * direct solutiicn for the 1 2 -station s ystem is simply a 
bs®A k core for display buffers- This approach has already been 
discussed* in a current proposal to- RAD 0- for system expansion. 

Our statistical observations indicate that the 940 could serve 
approximately 32 .NLS' users, if users interacted iwjftft the 940 on a 

work-ireqlu€st basis instead of a singl e-char ac ten basis* see 

( LQ&:S5» Usage ) 

U^en more than !2 work stations are considered, the 

sxaragl e-icfcaract e-r .-interaction with' the ti me^shari rg :sys tem and user 

pr-ogr airs ^completely overloads the system* 

Tsfte f irst criteri-on for any expansion' is thab it be expendable to 

t'he Units -of the 940* 

Tase s-econd is that the system closely resemble sore that ©ay be 
exp.an- deb le -to even larger service, say 100 consoles*" 

Itf such expansion' is :f lexible and modular in .its design and 
hardw.are jcoupling * threr alternative programming, scheduling, and 
qjueueirg -techniqu-es may be tried* The problems tof much larger 
systems m.ay be incisively studied and the solutions tested through 
i*np. lei'ment at ion. 
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It h s become apparent that c o 1 1 abora tioot in its many forms* must be 

i mp 1 i£:n 4i n t e d i in MLS . 

T^ree possible modes are: 

D i sp la y -frame shaningi where different logical parts of a 
user's current display picture may be viewed by a set of users 

InpLt-ld€v ice flexibility* where many people may sit around a 
table, each with his own handset and mouse; or users remote 
from each other can drive one another's displays 

Auidio iccmiBunicationt which takes two forms* 

Complete voice switching* so that any number of "conference 
calls** could be estaolished between the work-sta td on users 

Compute! — generated sound* used as feedback to a single user 
or a group of users in collaboration* 

Many io f these features can eventually be implemented totally 
entirely <within the framework of the 940. However* the current 
tvar dw ar e/ software approach imposes severe limitations in two ways. 

The 'MONITOR in the 940 time-sharing systet is cramped for 
space. This means that the extensive tables necessary for 
in put-idev ice i nt erchangeab ili ty will not fit* and limited* 
costly schemes would have to be implemented. 

The addition of hardware devices is governed by the 
avaaiiaibility : of special-purpose controller and polling devices* 

Each of these operates a fixed number of each kind ?of 

: cev-ice. 

Ue would prefer a scheme that allows new devices to be added 
anci interchanged freely and in small increments. 

Other :De*vices 

W&at .-about the printer? 

ye might want to move our printer to a small machine. 

■■W.iast sabout micr o--f il nv* cutput? 

ye might .want to drive a microfilm machine from a small 
maicfrine* 

W.ia-3t *afcout Model 37 T.'TYs? 

Wliat about the NET? 

The :idea is that the big core might serve as a buffer for 
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messages from the IMP. 

Hoiw£ver» we will wait until more is known .about the IMP before 

we: co any planning. 

Wtoat <ab ou L the NIC? 

The -idea here is that small machine could handle many NIC users 
if they ran a dedicated in format ion-re tr ie va I7ed it ing system. 
The small machines could be a single user on the 94*0* again 
reducing the swapping effort while maintaining high-speed 

respoase. 



Wfoat about storage tubes? 

Wft.at iafcout an on-line Dura? 
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THE MULTI-MINI-MACHINE APPROACH 



Genera 1 : Icea 

T.-h.i>rei is a big core of 16-bit words. Most of; it is used to store 

t&*» ring of all the display buffers* Some is used to store queues 
of tasks* tables for associating users and input devices, and 
rs entrant* interpretive code. 

C:anne.cted to the core, is a bank of small machines < 4K J 6-bit 
ycr-cls i 4 usee instruction times)* They are used as input-device 
cantr;oIlerSf Interpretive code executers for complex feedback, and 
c:h^nnel drivers; for the display channels. 

Gr\ass< V ie w 
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The sanal/l .computers more than meet the minimal time requirements* 

£;>2£h small machine has its own small core memory. If. it is 
operaitinci on the uring- structure and— determining feedback actioasi 
lz ico-ntains -an interpreter for reentrant code which, r esides in -the 

&!& core. 

This code is close to the code which is .compiled from 'the 
Sp-ecial-Purp'.os:e Languages (SPLs) for the current NLS. 

The code is not al gori thmi cal ly complicated. -Each input 
character involves* only a few logical deciisior. and table 

changes. 



The decisonst however* may involve reference to the user's ring 

of: cisplay buf f ers * . and ' the few hundred words necessary to 

deifinei his current'- status. 
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It is this large amount of information that causes the 
swapping overload in the 940,. 

By having all of this information immediately accessible (in 
core rather than on drum)* a small slow machine is more' than 

ad € quate. 

h£.p>y small machines were chosen over fewer faster ones because 
tikey could be manipulated and added in small increments^ 

Input icUvices*" along with the controlling processors f can be 
adidcd a few at a time as different experiments arise* 

Si nee )the logic for the feedback is in the big core, it may be 
expanced to two or even four time the orginal estimate- Thus 
the small machines will not be cramped for space. 

■F he structure of the display rings can be modified as 
information is gained on the nature of display collaboration* 
This would ne\/er be possible if the disp lay ^controller were 

bu:ilt iinio fixed hjardware- 

I:f ^a:ny machines are prepared to perform the same task* some 
s&:mpi e queuing snd access methods result in better machine 
Uiti'liizatiion and. small' changes in "system perf or marce as users 'are 

ad.ced * 

The queues are alb in the big core. There 3re two basic kiaads: 

As jcharaciers cone in to 'the dedi cate d input~controll er 
.maoMnest : they ;are associated with logical users and 
: deposited on input queues. 

Mhen they are free* the feedback machines poll these queues. 

iWhe-n characters are found* they are processed. 

• Sometimes the 940 must be requested -to intercede and 
icompletei a task. When this 'is so f ; the logical user -is • 
.put in a state of limbo as far as the feedback processors 
are cone erne ds and the task is queued :fcr the 940. 

ft jsiQpile 'ira-pletPientati on of. the ' "Di'jks tr a: F lag - * keeps two 
pr,*ocesss-crs from si.mul taneously modify irvg a data structure* 

■ ./111 the small machines .share a single access line to the big 
» core* Thus- only one can be doing a read or write on a - 

- single cycle. 

. Tiheire are-* however* three modes of" memo;ry eccesss readt 

- .write* &n6 Dijkstra read* In- the latter a word is read from 
. memory and sent to the small' machine. During the wr i te~*back 

i in it he big cere,* 'however* the top, bit iszcieared. 
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Suppose that a word in the big core is a ipcinter to a queue 
and that if the top bit is on t the queue is free; otherwise 

a processor is .working on the quque. 

If a processor D i jks tra-reads the pointer and the queue 
is free* it then has control of the qcece as well as the 

jpo inter to It. 

If the queue is in use» however* the processor is 
informed of this. 

Ttos 94C must have two kinds of control over the small ^machines* 

There is a two-way* interrupt line. 

This permits the small machine to not if y ?the 940 that there 

i is something on a queue* 

It :aiso permits the 940 to interrupt ithe sitall machine and 
requests -from a small resident program* sufficient 
i information to run a real-time debugg ing package* 

Iti is :also necessary for the 940 to exercise complete control 
at- certain times ( e.g- system star tup or a looping small 
iaa:chine>. To do tihis the 940 must be able to operate the 
console syitchesj land read most of the coasdU lights* 

Ther^ are tuo alternative methods of driving the displays on the 
sys te;tu. 

A 3 ma 1.1 m-achine could drive- the display directly- iThis would 
rs-^uilrc tlhe machine to output a word -to the d isp lay every 15 usee. 
Oaly ithe fastest (and most expensive) of the .small computers are 
cap a bile of doing -this* Even then they barely make it* -and cutting 

it this close seems inadvisable* 

lh-& ©jtfcer approach is to have- a data channel iwhich can be loaded 
anxt activated by the . small ma chin e. In this way the small maxshine 
siLilL interprets the ;ring structure and thus maintains the 
'f]l*sxiib.ili:ty there*. Using channels* the small machine can be 
r&lat:ivel y 'slow and s^till dri:ve the displays at f uil &apaci ty » 

Two '.auixilary: ideas are necessary to make- this :c iear* 

, A channel normally contains an address .register *and a word 
J count* These channels ".also contain an address-register 
. b-uf;fer an d a ward-count; buffer^* 

As the channel is driving the display from the workicng 
■ registers* tlhe small' machine can be loacing the buffer 

regis t ers . • 

i\Aben the chamnel is done* it issues an interrupt to ttse 
.small .machine* As soon as the machine has figured out 
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♦ where- the interrupt came from* it can pclse the channel. 
i Tire channel can then transfer the buffer registers to the 
working register and begin driving the displays again. 

iThis cuts the time between buffers from 60 usee to under 
2 usee. 

The small machine can still have problems keeping up with 
the display channel if the buf f ers .ar e displayed faster than 

the ring can be searched in the big core* 

To overcome this* the small machine only searches a ring 
iwl^en it is changed. As it searches a*simple list of 
inccessary buffers in made it the small if ac hire local 
'.memory- Thus the next channel address and word count are 

readily available within the immediate addressing 

structure of the small machine* 

iTfcese machines can keep close watch lover their time 
allocation* Single overloading of a display causes 
flicker only on that console; an extensive ring structure 
affects only, the consoles displaying fircm it; and in 
generatl* bQd side effects which now propagate from 
console to console are confined. 

Input Dei vices 

Spheral Input Devices 

Eaich device will be read as a source of I6r-bit code. Howey«r« 
the 'full' 15 bits will not .be used- Each device .will look 'the 
sa.'me to'the in put - machine*; i ts existence and type will be 
deifiined itfcro-ugh tables which can be 'set up anc modified by the 
9-4- (>• 

The ^devices planne6 for are: 

: A keyboard yfiich produces an 8~bit -code 

t> ito 16 pushbuttons* a'l though we wil 1 -start wit*fo only B '' 

. The mouse.* which requires two 10-bit numbers as coordinates* 
ano will thus take two words Cone- coord inate in each}* 

■Eajcir- sir -cup of '24 .Input devices .will have, a special polling 

meichan Ism which works in the following way* 

■■ ( 
> Jibe polling-' iray* be started and stopped :by the srmali machine* 

U hen 'the po.iling is in operation f it operates continuously " 
at its own rate* This will probably -be set so that each 

: cev-ice is sampled at least o>nce every 5 to 15" as* 

i Js each device -is sampled* -its contents' are read 'into- a core 
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location in tine small machine* 

:I f the device is a keyboard* however* it fie core location 
is changed only if the strobe is on* 

The input machine may then inspect the ilist in .core at a n 
slower ra:te« say every 30 ms# and notice any changes. 

I::ve f:o ilciw in 9 <ar e the maximum input rates for each device- While 
is. is unlikely that all devices will operate at maximum rate f*>r 
an exStcncec period of time (e.g«. one second)*' we must apian for at 
least) Iralf-second peniods of maximum transfer rates* 

linen a mouse is in notion* it is usually sufficient to update 
the tracking display buffer every 30 ms« The coordi nates must 
be observed at this ratei but they can be compared in the i*nput 
maichine* and if the mouse has not 'Changed position the 
coordinates are not associated with a logical user nor are the 
display buffers changed. 

The maximum rate fior a keyboard is slight ly sunder i$0 ms per 
character*, The keyboards are polled as fast as the mouse. 
Hoiwc'vert the ' character in -the core' of the. small machine is 
changed only, uhen it he strobe is on. ■ Thus 'the sma 11 machine has 
at: least 50 ras . tor notice and process any character. Every 
character must be associated with a Logical user and deposited 
o-n, the appro:prdat&' queue in the big core* along witih the tirme 
an d it he aiouse position* 

Th e .p vis tb ut t;o. ns are polled just like the mouse. < Every 30 msi - 
•the contents- must -be observed by< the input machine* " When any 
change* is noted* extra act ion "is required. 

I If jti*e but Ions -are on the mouse* 'the up or down action i^ist 
3 be associated with a user and deposited on a queue in 4>i«g 

> core along with the time and the moyse position. 

i If it fie buttons are on the handset*' changes .are ORed together 
: -en til all sw itches return to the UP. .status* 'The -chord Is 
-. then associated with the user and put onithe queue along; 
•* .with -the time and the' mouse position- 

■ 0ut?^..i D;evices 

■ T^sre will be only two high-speed output devices. 

Esict display' channel is loaded from a small machine and 
transfers words fr.onr t he • big core to 6 displays- bach channel 
has a '2 0- bit address register* a 16-bit word count* and an 
Initerrupt line back to the small machine- '• The interrupt is 

raised when the word count goes to zero* 

The amdio siu-itching system is viewed as a big switching matrix 

from t^he small machine. 
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> The* inputs are ,ail the voice lines and ail -tire Une 
5 en colors , Each tone is fed in as three separate lines <of 
amplitudes 3, 2 and 4. 

• The outputs from the matrix 90 directly to the speakers or 

. can phones • 

» The audio system is used at a ins rate when the tones are in 
a decay state (making them much more pleasant to listen to)* 

I:r:;.e following are- the. maximum, rates for' the tuo devices. These 
rales mayi be common* .and plenty of leeway must ibe allowed- 

Vih'en the display channels are running they do not effect the 
small machines* Thus the times which concern the siaali 
rasjcfcines '&r e: the length of time it takes to. load a channel <and 

th-e 'average length of time to process a buffer once the channel 

• ha s =be en start ed. 

( Ue expect the displays to write a character in 7 usee, so 

• the chamvels ui'll' trans fer a word from big core to 'the 

: ci splays ev ery 14 usee. 

, iBufifers can be a minimum of ! word longi and thus be 

• prole essed in 14' usee.' Normal iy, .however,;' they are .no 

- shcrter than 4 twerds* which takes 56 -usee* 

. To ikeep the disiplays running wide open,.- bhc small machines 

- shauld make every effort to minimize the stime to load a 

i fcufifer* Using 'the scheme discussed eanlier, 'this time can 

j fce cut to- less ithan 20 'usee* 

: If it fce -di-sp lays: are. storage tubes, the bu ff ers will be the 

• character strokes* and these will be stored in the bi^ core . 

•Jn this case the small machine will h$ve to look at tihe 
.buffer generated by -.the 940, take it apart- CAiracter by ■ 
icharacteri and drive- -the display uithithe individual 
icharacte-r - buf fers- 

•iSince the storage tubes take about I 00 usee to write a 
.full- character t this will not overloac the sinall machine, 
:althoiU-gh it twill' occupy almost all' of -.its time* 

Vo'ice 'switching- may be a s low process. -Tone decay, however, 
must be rapi>d»- 

£xtr.a . I/.Q iDe* vices : 

L^rall Dura? 
Sw^rai.ge lubes? '. 
Palter Pr. inter?: 

- 9- 
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i v ;o;ie.i. 3 7 .TTYs? - 

^firrroif lira Output?-? 

Steps for .Total Lnpu-t /Feedback- Service* 

T&.e - f.olloiwing is an outline of the steps ax* input machine will *go 
tforough as it gets characters from the input devices and puts the© 
iatiO itt-e .-appropr i*a te .queues in the big core. ^ This outline was 
u-s-ed to estimate the total processing capacity necessary in Ltoe 

i n$a:u t m a o h in es . 

tfrveck ■ queue for transfers to big core. 
Get ch^Acter from internal queue. 

¥<-ake correspondence between harduare device and logical 

user. 

Get queue- control for logical user. 
; Put' character on logical user in 'big core* 

, !*ake>wp appropriate* internal audio queue fro© logical user 

i information; in .big core. 

: -Give up queue control for logical user* 
Ge't .cl'odc interrupt.' 

.Co adown input- character buffer*. 

•If same as last interrupt do notching- 
;Otherju:ise 



If keyboarrdt note time and mouse positiont -.put on 
■queue- to 190 to big core. 

If pushbu ttons* decide whichs 

If,, mouse* note time and posit ion* put on queue to 

go to '/big core . 

If... handsets then 

if rail are up* this is a character end so note 
time and position and despoit on queue for big 

core. * 

Otherwise* build up chord fcyOJUng in ney do<un 
tout/tons. 



A-ud-io Queues 
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Do appropriate amplitude switching for* computes — generated 
iscund decay* remove processed entries sfroa queue. 

D^i e/Tirne..' Queues 

Sosje :of tihe small, machine will devote almost :all -of' their tiroe to 
searching the ring structures and driving the display channels* 

Get 'display channel interrupt. 

Use local list with update when ring changes* as discussed 
abo;ve. 

Have 'a 11 the entries in local memory* just put it up. 

Changes are flagged* and require a bl ock \ transf er of new 

pointers* 

Th^ rest ?of- the small machines will' be devoting all of their time' 
to .processing the input queues prepared toy i.the? input machines* • 
uipdat ing ^display buffers* and preparing queues for -the '940. T*be 
follow In gi outline* of stheir duties was: used to estimate the 
process in g capaci ty necessary - for the job- . 

ZHeck t fcr work: to ido. 

locale non-empty logical-user ta sk que«ue. 

Get -If M -.cont ro-1 for logical user. 

loptil icliarac.ter for processing. 

■■ Cet user state. 

. Begin execution/ of interpretive code. 

!£et character from queue. 

Get input-queue control for logical user*-' 

Get character off queue. 

Give "Up- input-queue control. 

-Step throu9h .main control. 

'-.Update appropriate- display: buff ers. 

■Hoy is this done if we have i*wig buffers? Is there a 

display :D i jkst r a ■ f lag? ■ 

■ There/ is :also the problem of writing in t#ie mouse 

■ coordinat-es whi le they are being changed. 
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iContitf&ue* until either 
Queue is empty z; 

Put him to' sleep. 
Or :940 is needed^ 

Put him on 940 queue. 
Set flag for 940 interrupt. 
'.Update date and ti roe 

GiiVe up IFM .control for logical user 
Ini t err upt t tee '940 i f nee es sary 
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PROPOSED HARDWARE 

Data t> Iq >u 
Interx'ajpt L tin es 
ipgbS Put-Get Bo.x - 

(<3dri- Address register* 20 bits 

tt<r) Transfer register* 16 bits 

( £& } F iijicit ion code 
Se:ad 
Vir. ite 

Diij-kstra test t 
A^u- t<o raait ic iiH cr em en t 
(ch) £ha;mnel 

Car&dr bi Channel address-register buffer* 2*0 bits 

i^u-rb-) Channel word-count buf fer* I 6 bits' 

Car.adr ) :.&d dress register* 20 bits 

ieac)" -Word coun t« 1.6 ibits 
(cc) ■ lorie .cen troll -er 

T^s-w:ay channel 
Ccsl Con- sale switches using 'the WOVji as an example* 

T3rf£> 16 *bii -NflS/A: readout registers — data- and 1 PC 

Siiacteiean bits of:-' input- switches 

Reado'-ulj of eitr^a -iniiaor-cy cl e console lights? ••■ 

S£r?i9l e scarry bit 

E&3&t>een functions to- select'' 
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PROGRAMMING TECMNIOUE 



Tfag v^O plays an important role in both the programming a*nd the 

running *.ot tihe ss.a.ll maohines. 

fros a pr ograGun in g po.int of vieuw everything can be dome on the 

9 ■&£).. 

Ih e ..interpreter for the small machine can be coupled with good 
DD,1 to give debugging aids far beyond those that could be 

piriOtti€ed by the small machine itself. 

Not only can checkout begin before the hardware is ready* b<ut 
programs cam. be changed and debugged wjiile tihe hardware is in * 

•us-e. 

Moreover* the file system of the 940 is available to the 944) 
Initsrplreter and DDT* so no nem file system has to be created* 

Tiaa 9 40 also has the .ability to operate tihe console, switches oSV 
e^ch .s*mail iuachine. This will be used in at .least three ways- 

DiUiriaragi initial startup- the 940 can bootstrap-load the machines* 

Wixile »t she machines are running* they can be Idsbuggeid froa tfoe 
94-s0« ;At any.-- time it he small machine can be stopped* - examined* - 
an d restarted on a usee basis. The 9«4t0 can then take the 
information -®nd 9 using symbol tables from assemblies and 
co.-mp illations « -proy ide a monitor and debugging service. 

Accuraite statistics may be gathered about -the operation of .'the 
ma-cliine* With control of the consoles* the 949 could even 
garitier samplings o.f the instruct ion- counter contents* something 
.wfrvich ■ is •normally :quite difficult. 

All t&ie programming for it he small machine will ; be -done.- i a a Machine ' 
Drienled Language si miliar to -the one in use on the 940 (HGL940) • 
The compiler jrfill sbe- written in -Tree Meta* an& should present no 
special idif icultii es . 

■ The ami e-npreit er asnd 'ODT ;for the small machines ui 11 be wri tten in * 
■MCL9&£» .and -operate on Vhe 940. ' Since the DD¥- is e&ecutidrag through 
■an i;*.A.-er,;preter» many fa%xcy f eatur.es : can be- added* .such as -operand - 
fetcfia br eakpiointsw memory reference 'breakpoint s« v ' autonatic. timing . 
~statii£ti'cs« :etc« There »uill be two modes of operation for the DDf • 

■On*a is jthe noriara 1. mude of executing- the code tujbttt the interpreter • 

Iic^ oiifren is the SYSdebug- mode* nhere' a live* running imachine is 
d^^>.ug:g-'. * In this case many \of the fancy features aay not yorlc 
Ci.d.ke seisory reference breakpoint * while in run model • 
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OTHER APPROACHES 

Only ni<Q> core 

single character -interaction -problem ; 
Single large external machine 

siuffiicien tly large core comes only with' bi>g cpu*St '-it fact too ? 

no f&ii s^a f e features 
f euetr -fa.ster mini-machines 

gr^uih comes in too liarge increments 

halfla^ tihe speed does not seem to double the capacity . 
All jaaeh ines usin-g single core' 

P&&r -addressing- structure' of small machines for f huge memory 

co--nsi£ered memory map it tradition of MUS-^too jumw core 

ey. cl es 

simple relabeling cause tr ouble in display rings 

re-quitrcs »too ma:ny- memory ports to keep ' smal-'l machine running ; 
efficiently 
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